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Abstract t/ 

Our research focuses on the problem of recovering from 
perturbations in large-scale schedules, specifically on the 
ability of a human-machine partnership to dynamically 
modify an airline schedule in response to unanticipated 
disruptions. This task is characterized by massive in- 
terdependencies and a large space of possible actions. 
Our approach is to apply both qualitative, knowledge- 
intensive techniques relying on a memory of stereotypi- 
cal failures and appropriate recoveries, and quantitative 
techniques drawn from the Operations Research com- 
munity’s work on scheduling. Our main scientific chal- 
lenge is to represent schedules, failures and repairs so as 
to make both sets of techniques applicable to the same 
data. 

This paper outlines ongoing research in which we are 
cooperating with United Airlines to develop our under- 
standing of the scientific issues underlying the practical- 
ities of dynamic, real-time schedule repair. 

Irregular Operations Scheduling (IOPS) 

Airline schedules are highly complex, structured ob- 
jects, with large numbers of internal interdependen- 
cies. Airlines must confront the consequences of uncer- 
tainty in the execution of their daily schedules — un- 
certainty stemming from inclement weather, sick calls 
from crew members, mechanical problems with aircraft, 
constraints on airport resources, and other problems. A 
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snowstorm at a key airport, for example, can have dev- 
astating consequences on the operations of an airline, ef- 
fects from which it may take days to recover. The inter- 
dependencies among factors like crew scheduling, main- 
tenance routing, and congestion at airports add further 
complication to the daily planning problem. Because 
of these interdependencies, even a single disruption and 
the consequent attempts at recovery typically involve 
widespread and long-lasting downstream effects. The 
search space of possible recoveries to a schedule disrup- 
tion is enormous. 

Airlines employ schedule planners who attempt to 
mitigate the effects of schedule disruptions. Their main 
goals are to minimize both passenger inconvenience and 
the cost of implementing the repair, while accounting 
for crew work rules, aircraft maintenance schedules, and 
other factors. An additional goal is to minimize the 
overall complexity of a repair. 

Controllers attempt to balance the trade-offs and un- 
certainties of irregular events, typically using informa- 
tion provided by various decision support systems such 
as real-time scheduling displays and passenger booking 
data. However, very few, if any, of these systems provide 
the planner with decision-making advice in the form of 
strategies or specific recommendations to counteract the 
adversity of a particular event. The goad of our research 
is to develop the scientific foundations for a new class of 
decision support tool to address this problem. 

From the viewpoint of Artificial Intelligence planning 
and decision support, the key features of the irregular 
operations planning task are: 

• Airline schedules are large, complex, and highly inter- 
dependent. 

• Solving schedule problems by exhaustive search is 
generally infeasible. 

• Current situations typicadly share more with past sit- 
uations than they differ from them. 
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• While they may be similar, no two situations are ever 
entirely identical. This means that simply storing and 
reusing a “library” of solutions will not suffice. 

The size of the search space, together with the re- 
curring nature of typical problems, suggests a solution 
based on the re-use of plans. But re-using plans means 
more than just retrieving and replaying old solutions. 
Because the details of situations change over time, the 
system will need to be able to notice that a retrieved 
plan does not exactly fit the current situation, there- 
fore it will need to modify its retrieved plans to fit new 
situations. 

Our approach to plan repair is to provide qualitative 
expertise in the form of a case library linking descrip- 
tions of stereotypical problems with appropriate recov- 
ery strategies, an d quantitative expertise in the form 
of optimization techniques drawn from the Operations 
Research (OR) community. The goal of our research is 
to develop the scientific foundations for a new class of 
decision support tool. The IOPS Advisor, currently un- 
der development, couples the experiential know lo dge of 
schedulers, which is essential in generating strategies for 
solving a schedule problem, with the quantitative power 
of operations research techniques, which are effective in 
comparing the costs and effectiveness of the potential 
solutions generated by those strategies. Furthermore, 
the quantitative models may be responsible for optimiz- 
ing the details missing from a sketchy solution suggested 
by a qualitative strategy. For example, if a strategy is 
“stop to refuel”, a quantitative analysis may indicate 
where to stop and how much fuel to take on. 

The IOPS Advisor, currently under development, is 
intended to represent schedules, failures, and repairs so 
that both sets of techniques can cooperate using the 
same representational constructs. 

Research Objectives 

The primary scientific focus of this work is on represen- 
tation. Specifically, we are determining how to represent 
schedules, schedule failures, and repair strategies so as 
to enable the IOPS advisor to: 

• Identify and characterize schedule problems so as to 
determine the applicability of prior solutions or spe- 
cific quantitative techniques. 

• Acquire new descriptive features as they become nec- 
essary to discriminate among otherwise indistinguish- 
able situations. 

• Compare the applicability of multiple, competing so- 
lutions to the same problem. 

Knowledge Representation Issues: 

The main knowledge representation issue, and the pri- 
mary focus of our current activity, is to categorize and 
represent the heuristic knowledge used by controllers 
and OR analysts, specifically; 


• How problems are detected and described. 

• What problem-solving strategies exist. 

• What aspects of a problem indicate the applicability 
of one strategy over another. 

In order to gather a realistic set of failures and repairs, 
we have been observing controllers as they detect, diag- 
nose, and repair schedule problems. Our initial study 
has suggested^o us that controllers build and use so- 
phisticated, high-level repairs from a small number of 
primitive operators. The primitives form the basic rep- 
resentation vocabulary used to describe actions, and it 
is anticipated that the list will be stable over time. The 
higher-level strategies, on the other hand, are more dy- 
namic, and one of our tasks is to model the acquisition 
of new high-level strategies. 

Typical primitive operators represent concrete actions 
like: 

• Cancel a segment 

• Delay a segment 

• Divert a flight to a different airport 
Substitute one aircraft for smother 

• Substitute one crew for another 

• Ferry an empty aircraft from one airport to another 

Higher-level strategies, on the other hand, may in- 
volve both primary actions and secondary actions de- 
signed to mitigate the side-effects of the primary actions. 
Or, they might involve a series of steps taken to defer 
the impact of a problem, in the expectation that an op- 
portunistic solution may present itself in the intervening 
time. Other high-level strategies include geographically 
localizing the impact of a problem or, conversely, dilut- 
ing the impact of a problem by spreading a minor delay 
across several geographic poin ts. * " ; i: J 

As we gather more high-level strategies from our ob- 
servation of controllers and from our encoding of quanti- 
tative techniques, our plan is to encapsulate the strate- 
gies in knowledge structures that also include descrip- 
tions of appropriate situations for the strategies. The 
IOPS advisor will extract from the user a description 
of the current situation, propose repair strategies based 
upon the match between the current situation and the 
stored descriptions, and quantitatively evaluate the util- 
ity of situations generated by competing strategies. As 
it performs this selection and comparison, it can acquire, 
from the user, information about features of the world 
that determine the applicability of one strategy over an- 
other. These newly-acquired features can then become 
part of the selection criteria encoded with the strategies 
in memory. 

Knowledge acquisition 

While the list of primitives is expected to remain rela- 
tively static, an important aspect of the IOPS Advisor 




128 


is that it will be able to acquire new descriptive features 
as it is used. If the system erroneously suggests a prior 
case as being a good match to the current situation, the 
user can correct this by supplying a descriptive feature 
that would differentiate the current situation from the 
case stored in memory. The error might have occurred 
either because the discriminating feature was not men- 
tioned in the description of the current situation, or be- 
cause it was not mentioned in the stored case. In the 
latter scenario, it can be added. 

In general, a longer-range goal for the IOPS advisor 
is that, in having a human user interact with a plan- 
ning tool, we have an opportunity to record information 
about plan accessing strategies, modification techniques 
and typical failures that can, in turn, become the heuris- 
tics used by a more autonomous system. A system that 
observed human schedulers in action and recorded their 
responses to specific planning problems, and which in- 
dexed those responses in memory using the functional 
criteria discussed above, would become a powerful ex- 
pert assistant — an assistant with a good memory for 
what worked and what didn’t in the past. 

Case-Based Planning Issues 

While case-based planning addresses many of the qual- 
itative problems in the irregular scheduling domain, 
much work must be done before a practical system could 
be put in the hands of a human scheduler. Fortunately, 
the core idea in case-based planning, that of incremen- 
tal modification, is one aspect of the technology that 
could be usefully applied in the near term as a way to 
deal with the type of changes that have to be made to 
schedules during execution. 

One of the recurring problems of automated planning 
is the issue of the repairs that have to be made during ex- 
ecution as a result of unforeseen circumstances. There 
are always unexpected problems that arise. Weather, 
crew sickness, and equipment failures cannot be pre- 
dicted. Bottlenecks show up where none was suspected. 
Each of these classes of problems can be recognized using 
a specific set of symptoms, and each requires a specific 
type of repair. 

Run-time repair and optimization, while useful, has 
to be traded-off against the overall stability of an exist- 
ing plan. If a single aircraft is unexpectedly grounded, 
one form of optimization might be to rebuild the en- 
tire system schedule, minus that aircraft. But even if 
such a repair were computationally feasible, implement- 
ing it would be preposterous. A planner that deals with 
unexpected changes in the state of the world by com- 
pletely replanning will be constantly creating new plans 
that will do little more than confuse the people that are 
using them. What is needed instead is incremental, lo- 
cal plan repair, coupled with local optimization. One 
wants to perturb the schedule as little as possible in the 
achievement of an acceptable response to an unexpected 
occurrence. 


Much of the emphasis of CBR research to date has 
been on issues of plan indexing, retrieval and modifi- 
cation. While these issues are clearly present in this 
domain, our emphasis is primarily on plan evaluation 
through objective analytical (OR) tools which are also 
under development. Specifically, we are focusing on how 
to direct the search for relevant cases based on the OR 
model’s assessment of the feasibility or "utility” of pre- 
viously proposed solutions. Because the two sets of tech- 
niques tend to characterize the problems differently, in- 
tegrating them is a challenge. 

Operations Research Issues 
Operations research analysts tend to think in terms of 
opportunities for optimization. One of our preliminary 
findings is that schedule planners do not readily identify 
these opportunities. Accordingly, an important aspect 
of the integrative research is to identify classes of situ- 
ations in which particular optimization techniques are 
appropriate, and to select descriptive features that al- 
low the system or planners to differentiate among these 
classes. We intend to codify this knowledge in the form 
of cases which couple the relevant optimization tech- 
niques with characteristic features of the appropriate 
class of situation. 

Case Study 

The following hypothetical case study is based on ob- 
servations of airline planners. The case illustrates the 
interplay between qualitative and quantitative reason- 
ing described in this paper. Airports are designated by 
the following three letter codes: SFO = San Francisco, 
EUG = Eugene, and MED = Medford. 

A runway construction project at EUG has imposed 
a weight restriction on departing flights. A depart- 
ing flight EUG-SFO is over the weight limitation by 
approximately 20 passengers. The flight is sched- 
uled to depart on time, however, inbound flow con- 
trol is in effect at SFO (due to fog) and is imposing a 
53 minute pre-takeoff delay on the EUG-SFO flight. 

The planner generates some alternative solutions: 

1. Move the excess passengers to a later EUG-SFO flight. 

2. Have a flight enroute to SFO passing nearby EUG 
stop to pick up the excess passengers. 

3. Remove enough fuel to carry the excess passengers, 
and stop at an intermediate point to refuel. 

At this stage, the alternatives are qualitative: they 
simply match a problem with a strategy. Although in 
many cases this step of the solution process is trivial 
(e.g., weather-related IOP forces cancellations), we be- 
lieve that in general this step is non-trivial and it is 
one aspect of the planner’s job which distinguishes an 
experienced planner from an inexperienced one. 

The next step of the planning process involves evalu- 
ating the relative merits of each proposed strategy with 
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respect to the planner’s goals. In this case the planner 
chose not to solve the problem using strategy (1) be- 
cause pushing the problem to a later flight would most 
likely cause weight restriction problems downline and 
would disservice the excess passengers. Strategy (2) was 
not chosen since it would involve delaying a large num- 
ber of passengers on a different flight to accommodate a 
relatively small number of connecting passengers on the 
EUG-SFO flight. On further analysis of strategy (3), the 
controller determined that, since SFO air traffic control 
had already imposed a 53-minute delay on the inbound 
flight for reasons of airspace crowding, the flight could 
in fact refuel at MED and carry all passengers to SFO as 
planned without incurring additional delays. The cost 
of landing and departing at MED was considered negli- 
gible in comparison to the alternative costs of delaying 
passengers and causing misconnections of aircraft and 
people (although this calculation was not performed ex- 
plicitly). 

Notice that the planner’s analysis in choosing among 
alternatives remains highly qualitative. The planner 
uses various sources of information to determine the vi- 
ability of each approach, however, he rarely explicitly 
calculates the cost impact of various strategies. We be- 
lieve that at this stage the planner could be greatly added 
by OR models which: 

• provide an objective analysis of the relative merits of 
each strategy based on utility measures. 

• determine optimal implementations of high-level 
strategies, for example, given strategy (2), choosing 
an appropriate flight, or, given strategy (3), choosing 
an appropriate airport. 

Anticipated Results 

Our key preliminary result is a growing catalogue of 
stereotypical problems and appropriate repair strate- 
gies, which form the backbone of a domain theory of 
schedule failure repair. We anticipate that a longer- 
term result of our research will be a working prototype 
of the IOPS Advisor System. This prototype will em- 
body the failure descriptions and recovery strategies, as 
well as a set of features characterizing appropriate situ- 
ations in which to apply specific quantitative optimiza- 
tion tools. The knowledge-based system will suggest 
strategies, given a description of the problem, while the 
OR components will be responsible for evaluating the 
costs and benefits of the proposed strategies and for de- 
termining specific implementations of the strategies. 

Evaluation 

The bases against which we can evaluate the IOPS ad- 
visor project are: 

• Does the system enable a controller to produce good 
schedule repairs? In particular, can a controller use 
the system’s prepackaged strategies and OR evalu- 


ation methods to improve upon solutions produced 
using the controller’s own judgment? 

• How good are the high-level strategies that the ex- 
perienced planners employ? How often do controllers 
choose the best strategy? While the strategies obvi- 
ously work, are they applied inappropriately? Does 
post-facto analysis repeatedly indicate that some 
other strategy might have been preferable? 

• Are individuals able to make use of the canned strate- 
gies? Can one individual recognize and re-use canned 
strategies? Is there any transfer across individuals, 
such that one individual can use strategies developed 
by smother? If so, how should the strategies be pre- 
sented to the user? 

• Can novices use the strategies and optimizations from 
the IOPS advisor to generate expert-like repairs? In 
general, how do solutions built by novices differ from 
solutions built by experts? Does the availability of a 
library of expert solutions improve a novice’s perfor- 
mance? 

• Does the integrative AI/OR approach provide a bet- 
ter method than either technique applied alone? Is it 
even possible to model the IOPS problem using either 
technique alone? What form would these models take 
(e.g. large scale linear programming, expert-system)? 
How would each of these approaches compare to the 
integrative approach? 

Summary 

The airline irregular operation problem is representa- 
tive of a general class of scheduling problems. An ideal 
solution would embody both the best quantitative tech- 
niques and the genuine expertise of skilled, experienced 
controllers. Traditionally, the two classes of solution 
have been described in such divergent terms as to make 
integration, or even comparison, difficult. By building 
a uniform representation of schedules, failures and re- 
pairs, our intention is to provide a framework for ex- 
perimenting with qualitative and quantitative solutions 
and, ultimately, for integrating the two. 
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